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Abstract 

We consider strong law of large numbers (SLLN) in the framework of game- 
theoretic probability of Shafer and Vovk (2001). We prove several versions of SLLN 
for the case that Reality's moves are unbounded. Our game-theoretic versions of 
SLLN largely correspond to standard measure-theoretic results. However game- 
theoretic proofs are different from measure-theoretic ones in the explicit consid- 
eration of various hedges. In measure-theoretic proofs existence of moments are 
assumed, whereas in our game-theoretic proofs we assume availability of various 
hedges to Skeptic for finite prices. 

Keywords and phrases: Borel-Cantelli lemma, call option, Doob's upcrossing lemma, 
Kronecker's lemma, Marcinkiewicz-Zygmund strong law, martingale convergence theorem. 

1 Introduction 

In the framework of game-theoretic probability, proof of SLLN is simple if Reality's moves 
are bounded. In j4j we showed that a single simple strategy based on past averages of Re- 
ality's moves forces SLLN for the case of bounded Reality's moves. For the special case of 
the coin-tossing game path behavior and convergence rate of SLLN can be very explicitly 
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stated ([S],jH]). However when Reality's moves are not bounded, the proof becomes more 
comphcated due to consideration of availabihty of hedges to Skeptic. Under the require- 
ment of the collateral duty that Skeptic has to keep his capital always nonnegative, he has 
to use some form of hedge at each round. In Chapter 4 of Shafer and Vovk (2001), Kol- 
mogorov's SLLN is proved under the availability of the variance hedge (quadratic hedge). 
Shafer and Vovk consider the case that the price of the variance hedge is announced by 
Forecaster for each round, but for simplicity in this paper we omit Forecaster from the 
protocol and consider the case that hedges carry constant prices throughout the game. 
Availability of the quadratic hedge is natural and convenient. However the purpose of 
this paper is to investigate SLLN under other types of hedges. 

In measure-theoretic probability, the usual and most elegant form of SLLN is stated 
for the sample average x„ = {l/n){xi + ■ ■ ■ + x„) of i.i.d. random variables, where only 
the existence of the measure-theoretic expected value < oo is assumed. However 

Kolmogorov's SLLN proved in Chapter 4 of Shafer and Vovk (2001) does not correspond to 
this version and a question remains whether a corresponding game-theoretic result holds or 
not. Some considerations of this problem are given in Chapter 4 of The usual measure- 
theoretic result depends strongly on the assumption of identical distribution of the random 
variables. On the other hand the basic feature of the game-theoretic probability is that the 
game is a martingale and there is a question of how to impose identical behavior to Reality 
at each round. In this paper we argue that the assumption of the identical distribution 
in measure-theoretic framework can be replaced by the availability of countable number 
of weak hedges. 

For the most part we follow the standard proofs of SLLN in measure-theoretic proba- 
bility. For example we use truncation and Kronecker's lemma. However our proofs differ 
from standard measure-theoretic proofs in explicit construction of Skeptic's strategy which 
requires Skeptic to observe his collateral duty. In addition our proof is more an extension 
of the proof for the bounded case of Chapter 3 of Shafer and Vovk (2001), rather than an 
extension of their proof in Chapter 4 using the quadratic hedge. 

The organization of this paper is as follows. In Section |21 we set up notations and give 
some preliminary results. In Section |21 we prove a version of SLLN under the assumption 
of availability of a single hedge. In Section 0] we prove a game-theoretic version of SLLN 
for i.i.d. variables under the assumption of availability of countable hedges. We extend 
it to a Marcinkiewicz-Zygmund strong law in Section |31 Finally in Section IHl we discuss 
various aspects of our proofs and the assumption of availability of infinite number of 
hedges. 

2 Notation and preliminaries 

In this section we summarize our notations and some preliminary results. We follow the 
notation of Shafer and Vovk (2001). C, = X1X2 ■ ■ ■ denotes an infinite path of Reality's 
moves and C,'"' = Xi . . . Xn denotes the partial path up to round n. For a strategy V of 
Skeptic, /C^(0 = ^n(^") denotes the capital process. Starting with a positive initial 
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capital of /Co = 5 > 0, Skeptic observes his collateral duty by using V if 

/Cr(O>0, Ve,Vn. (1) 

We also say that V satisfies the collateral duty with the initial capital 5. Note that V 
satisfies the collateral duty with initial capital 5 if and only ifV/6 satisfies the duty with 
the initial capital 1. In view of this fact, we simply say that V satisfies the collateral duty 
if V satisfies the duty with some initial capital 6 > 0. When V satisfies the collateral 
duty, the capital process K.^ is called a (game-theoretic) non-negative martingale. 

We call a function h{x) of Reality's move x a hedge if it is non-negative {h{x) > 0, Vx G 
M) and has a finite price < u < oo. Skeptic is allowed to buy arbitrary amount of h{x) 
with the unit price u. In Chapter 4 of Shafer and Vovk (2001), they consider the variance 
hedge h{x) = x^. In view of the unbounded forecasting game in Chapter 4 of Shafer and 
Vovk (2001), we first consider the following protocol with a single hedge. 

The Unbounded Forecasting Game with a Single Hedge 
Protocol: 
/Co := 1. 

FORn = 1,2,...: 

Skeptic announces M„ G M, y„ > 0. 
Reality announces Xn G M. 

fCn ■= /Cn_i + MnXn + Vn{h{Xn) - 

END FOR 

Availability of the variance hedge h{x) = x"^ is very convenient, because Skeptic can 
then construct a martingale which is a quadratic form of Reality's moves. This fact is used 
by Shafer and Vovk in their proof. However SLLN can be proved under other hedges. In 
Section 121 we will prove that SLLN is forced if the absolute moment hedge of order 1 -|- e, 
e > 0, 

h{x) = \x\^+' 

is available to Skeptic. Naturally we are tempted to consider the absolute moment hedge 

h{x) = \x\ 

in the above protocol, corresponding to the measure-theoretic SLLN of i.i.d. random 
variables with finite expectation. However it is essential to point out that SLLN is not 
forced under the availability of h{x) = \x\ alone. Since this fact is important, we state it as 
a proposition. The following proposition is stated in view of the Marcinkiewicz-Zygmund 
strong law in Sectional 

Proposition 2.1. Consider the unbounded forecasting game with a single hedge h{x) = 
Ixl"^ , r > 0. There exists no strategy V of Skeptic satisfying the collateral duty, such that 
lim„ /C^ = oo whenever (xi + ■ ■ ■ + x„)/n^/'" -/-^ 0. 

Proof of this proposition, following Section 4.3 of Shafer and Vovk (2001), is given in 
Appendix |XJ Unfortunately it requires a measure-theoretic argument. 
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Figure 1: Symmetric call option type hedge 

Because of Proposition 12 . 1 1 with r = 1, we need to assume that more hedges in addition 
to h{x) = \x\ are available to Skeptic in order to prove SLLN corresponding to the sample 
average of i.i.d. random variables with finite measure-theoretic expected value E\xn\ < oc. 
Let 

n = {hx\\eA} 

denote a set of hedges available to Skeptic in each round. For example in Section 0] we 
consider the set of symmetric call option type hedges ("strangle hedges", Chapter 10 of 

m 

n = {i\x\-ku\k = 0,1,2,...}, 

where x+ = max(0,a;). — /c)+ is depicted in FigureHJ We assume that h\ is available 
to Skeptic with a constant finite positive price ■ Skeptic is allowed to buy any amount 
of countable number of hedges hi,h2, . . . from H. If Skeptic buys G M units of hi, 
i = 1,2, . . . , then he is required that the sum ViVh, converges to a finite value. Note 
that here for a set of hedges we are allowing Skeptic to sell a hedge (V^ < 0), whereas in 
the case of a single hedge Skeptic can obviously only buy the hedge. By allowing Skeptic 
to sell hedges, he can combine various hedges to construct a variety of hedges (Chapter 10 
of [Sj, Section 9.3 of IJ). Based on these considerations we set up the following protocol. 

The Unbounded Forecasting Game with a Set of Hedges 
Protocol: 
/Co := 1. 

FORn= 1,2,...: 

Skeptic announces M„ G M, hni, hn2, ■ ■ • G 7Y, Vni, Vn2, ■ ■ ■ G M 

s.t. J2i VniVh„i converges to a finite value. 
Reality announces Xn G M. 

/C„ := )Cn-l + MnXn + Y.i Vni{hni{Xn) " f/i„J- 

END FOR 

In our proofs we combine Skeptic's strategies to force intersection of events. From 
Section 3.2 of Shafer and Vovk (2001), a strategy V weakly forces an event E if it satisfies 
the collateral duty and limsup„ /C^(^) = oo for every ^ E. In this case we also 
say that E happens almost surely. If limsup„ is replaced by lim„, then V forces E. Now 
consider two events Ei and E2. We say that a strategy V weakly forces E2 conditional 
on El if it satisfies the collateral duty and 

hm sup X:® (0 = 00, y^eEiDE^. 
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Now we state the following lemma, which is slightly stronger than Lemma 3.2 of Shafer 
and Vovk (2001). 



Lemma 2.1. Suppose that Skeptic can weakly force Ei and furthermore he can weakly 
force E2 conditional on Ei . Then he can weakly force EiH E2. 

Proof. Let Vi denote a strategy weakly forcing Ei and let V2 denote a strategy weakly 
forcing E2 conditional on Ei. Let V = (1/2) (Pi + V2). Note that 

{EinE2f = Ef' U{EinE^). 

For G -Ef lim sup„ IC^{C,) = 00 since lim sup„ /C^^ = 00. Similarly for For ^ G i^i fl-E^ 
limsup^ /C^(,^) = 00 since lim sup„ /C^^ (^) = 00. □ 

It is clear that Lemma l2.ll can be generalized to the sequence of events Ei, E2, . . . , 
such that Ei is weakly forced conditional on i?i fl ■ ■ ■ fl Ei_i. 

Finally we state and discuss the game-theoretic martingale convergence theorem given 
in Lemma 4.5 of Shafer and Vovk (2001). 

Lemma 2.2. A non-negative martingale converges to a non-negative finite value 
almost surely. 

As seen from the proof of Lemma 4.5 of Shafer and Vovk (2001) this theorem is based 
on Doob's upcrossing lemma in the game-theoretic setting. We use this lemma in our 
proofs in an essential way. As discussed at the beginning of this section, when we say 
that IC^ is a non-negative martingale, it means that Skeptic observes his collateral duty 

with the strategy V starting with a positive initial capital JCq > 0. In this case he 
can construct another strategy Q satisfying the collateral duty starting with an arbitrary 
small initial capital 6 > such that 

lim/C2(e) = oo 

n 

whenever /C^ does not converge. As in Section 4.2 of Shafer and Vovk (2001) or Chapter 
12 of Williams (1991) we use Lemma [2.21 in conjunction with Kronecker's lemma. 

3 SLLN with a single hedge 

In this section we give sufficient conditions for SLLN in the unbounded forecasting game 
with a single hedge. For simplicity we only consider symmetric hedge h{x) = h{\x\) 
depending only on We assume several conditions for /i(|a;|) > 0. 
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(Al) For some c > 0, ^d^;]) > for |a;| > c. (2) 
(A2) For some c > and for all a > 1 
h(\x\) 

is monotone increasing or decreasing for |x| > c. (3) 



\x\ 



oo ^ 

(A3) For some c> 0, — — < oo. (4) 



n>c 



In our proof the condition (A3) is essential for SLLN with a single hedge, as shown 
in Proposition 13.11 below. On the other hand (A2) and the symmetry of h are assumed 
for convenience for our proofs, c > in the conditions can be easily handled and for 
simplicity we assume c = in our proofs below. By (A2), there exists some > such 
that /i(|a;|) is monotone increasing in \x\ for a > ao and monotone decreasing in |x| for 
a < Oq. 

Now we state the following theorem. 

Theorem 3.1. Suppose that a single hedge h{x) satisfying (A1)-(A3) is available to 
Skeptic. Then in the unbounded forecasting game with the single hedge h{x), Skeptic can 
force Xn 0. 

Take h{x) = \x\^+', e > 0, then (Al)-(A3) hold and SLLN is forced. SLLN is forced 
even for 

h{x) = |a;|(log |a;|)^. 

However as shown in Proposition 12.11 SLLN is not forced for h{x) = \x\. 

Before starting the proof of Theorem 13.11 we show that the condition (A3) is also 
necessary for the existence of a strategy weakly forcing SLLN. 

Proposition 3.1. Consider h{x) > with h{0) = and XlnV^l'^) — Then in 

the unbounded forecasting game with this single hedge h{x), there exists no strategy V of 
Skeptic satisfying the collateral duty, such that lim„ /C^ = oo whenever (xi + - ■ ■+Xn)/n -/^ 
0. 

Proof of this proposition is given in Appendix 1X1 

The rest of this section is devoted to a proof of Theorem 13.11 in a series of lemmas. 
By Lemma 3.1 of Shafer and Vovk (2001) we only need to show that Skeptic can weakly 
force Xn ^ 0. 

Lemma 3.1. Let 

Under the conditions (A1)-(A3) Skeptic can force Ei. 
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Proof. By (A3) let C = J2n ^/h{n) < oo. Consider the following strategy V 

Mr,. = 0, K, ^ 



Cuh{n) 



where < z/ < cxo is the price of the hedge h. For this strategy, starting with the initial 
capital of /Co = 1, the capital process /C„ is written as 



n ^ 

/C„ = 1 + V -7rTr\ih{xi) - ^) 
^ Cuhii) 

1=1 ^ ' 

= 1 1 1 1 h{xi) 

C ^ h{%) Cv^ h(i) 
1=1 ^ ' 1=1 ^ ' 



1 

h{i) ' 

Therefore V satisfies the collateral duty and on /C„ diverges to +oo. Therefore V 
forces El. □ 



Note that the same argument with C = shows that Skeptic can force 

E[ = {^\J2'^<oo}. (5) 

n 

Furthermore Lemma f3.1l implies the following Borel-Cantelli type result. 
Lemma 3.2. Let 

E2 = \ \xn\ > n for only finite number of n}. (6) 
Under the conditions (A1)-(A3) Skeptic can force E2. 

Proof. By (A2) /;,(|a;|)/|x| is monotone. If it is monotone decreasing (A3) can not hold. 
Therefore /i(|x|)/|a;| has to be monotone increasing and /i(|a;|) is itself monotone increasing. 



Therefore for z > 



hiz) ^ , , 



h{n) 

where /[n,oo)(-) is the indicator function of the interval [n, 00). It follows that Ei C E2. □ 

It should be noted that this lemma is essentially the first part of Borel-Cantelli lemma. 
For convenience we state a game-theoretic version of the first part of Borel-Cantelli lemma. 
The proof is the same as in Lemma 13.11 and omitted. 

Lemma 3.3. (The first part of Borel-Cantelli) Let Ei, E2, ... be a sequence of events 
such that the sum of the upper probabilities is finite J^n-^i^ri) < 00. Then Skeptic can 
force 

(limsup i^n)*" = {En only for finite n}. 
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The following lemma concerns the evaluation of the variance of truncated variables in 
the usual proof of SLLN. 



Lemma 3.4. Let 

^3 = {eiE^^{W<"}<^}- (7) 



X2 
1- 



n 

Under the conditions (Al)-(A3) Skeptic can force E^. 

Proof. First consider the case that h{x)/x'^ is monotone increasing. Then adjusting some 
constants we can assume h{x) > for all x without loss of generality. Then 

^2-'{|^n|<n} - ^2 - ^2 

and E[ G E3, where E[ is given in (jS)). Therefore Skeptic can force E^. 

Next consider the case that h{x)/x'^ is monotone decreasing. For < z < n we have 

h{z) ^ 
2-2 — ^2 

Multiplying both sides by /h{z) we have 

^2 



< 



ri^ h{n) 
Then 

and £"1 C £"3. □ 

From Lemma f3. 21 and Lemma (3.41 Skeptic can force £'2 fl i?3. 

Lemma 3.5. Let < c < 1/[2(1 + iy/h{l))]. Then for all x 

\x\ h(x) — V 1 

— c— + c > . 

n /^(ri) ~ 2 

Proof. Since h{z)/z is increasing in z > 0, for z > n we have h{n)/n < h{z)/z. Multiply- 
ing by z/h{n) we have 

^ _ _ > 0, z > n. 

For < z < n obviously 

h{z) z 
h{n) n 

Therefore for all 2; > we have 



> -I. 



h(z) — V z V V 

> -1 - — - > -1 - 



h{n) n h{n) h{l) 

and this proves the lemma. □ 
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Finally the following lemma proves Theorem 13.11 by Kronecker's lemma. 
Lemma 3.6. Let 

-E4 = I — converges to a finite value}. 



Under the conditions (A1)-(A3) Skeptic can weakly force E4 conditional on Ei. 
Proof. Let < e < 1/[2(1 + v/h^l))]. Consider the following strategy P"*": 

Mn = e/C„_i-, Vn = e/C„_i- 



n n[n) 
Then by Lemma (3.51 

/C„ = + e h e — — - — ) > -r^n-i 

n n{n) 2 

and satisfies the collateral duty. Similarly the strategy V~ with M„ = — e/C„_i/n, Vn = 
e}Cn-i/h{n) satisfies the collateral duty. By the game-theoretic martingale convergence 
theorem (Lemma 12. 2|) both /C^^ and /C^ converge to a non-negative finite value almost 
surely. Then both log/C^^ and log/C^ converge to a finite value or —00 almost surely. 

As in Lemma 3.3 of Shafer and Vovk (2001) we use the inequality t > log(l+t) > t — t"^ 
for all t > —1/2. Then the logarithm of the capital process for V'^ starting with JCq = 1 
is bounded as 

(--^I(zr^- " " 

i=l ^ ' 

i=l ^ ' i=l ^ ' 

On El, each of the following infinite sums is finite. 

n n n n n ^ 

By the inequality 

(ai H h Om,)^ < ■m{al H h a^) 

on El the second term on the right-hand side of (jH)) converges to a finite value: 



00 



E.Xn /l(x„)-Z/.2 
I rT~\ — I < 
^ n h{n) ' 



Therefore conditional on Ei weakly forces 



lim sup < 00. 



i=l 
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Similarly conditional on Ei V weakly forces 

n 

liminf > — < — oo. 

n i 
i=l 

It follows that the case hmlog/C^^ = — oo is eliminated and log/C^^ converges to a finite 
value almost surely. 

Now consider Q for the interval n < i < n'. Then 

i=n, 

-^^^ i hii) ^ ^ I hii) ^ ■ 

i=n ^ ' i=n ^ ' 

Now by Cauchy criterion we see that 'Ylm^n/n converges almost surely. □ 



4 SLLN with countable hedges 

In this section we prove a version of game-theoretic SLLN which corresponds to the 
usual measure-theoretic SLLN for the sample average of i.i.d. random variables with finite 
expectation. As shown in Proposition 12.11 the availability of a single h{x) = \x\ is not 
sufficient. It seems that an essential ingredient of measure-theoretic proofs of SLLN 
for this case is that the expected values of truncation are uniformly bounded by the 
assumption of identical distribution. Hence we consider that countable number of hedges 
are available with constant prices at each round of the game. We assume that the prices 
are given in such a way that the game is coherent, i.e. the game does not present an 
arbitrage opportunity to Skeptic (see Section 7.1 of [7j or jH]). 

As mentioned in Section El for our game-theoretic version of SLLN we assume that 
the set of symmetric call option type hedges with integral exercise prices A; = 0, 1, 2, . . . 

n = {hkix) = (|x| - A;)+ I A; = 0, 1, 2, . . . } (10) 

are available to Skeptic. In particular |x| = (|a;| — 0)+ is available to Skeptic. Let u^. 
denote the price of h^^x) = (|x| — k)+. We also assume that Skeptic is allowed to sell 
hedges and combine them, as long as he observes his collateral duty. For example he can 
create a new hedge 

|a;| < k 
k, k < \x\ <k + l 
|x| > A; + 1. 

This new hedge carries the price of z/^ — Uk+i > 0. We may call this hedge "symmetric 
bull spread" (c.f. Chapter 10 of 0). 



{\x\ - k)+ - {\x\ 



1)- 
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For truncation arguments below we also consider "symmetric trapezoidal hedge" . For 
k > 1 define 



T,(x) = (|x|-(A;-1))+ 


- (|x| - kU - {i\x\ -ik + 1))+ -{\x\-ik + 2))+) 




'o, 


\x\ < k — 1 




l^l - (A; - 1), 


k — 1 < \x\ < k 


= < 


1, 


k < \x\ < k + 1 




k + 2- \x\, 


k + l<\x\<k + 2 




.0' 


k + 2 <\x\ 



with the price /ifc = iyk+2-'^k+i-^k + ^k-i- For A; = 0, To(x) = 1 - - 1)+ - -2)+), 
which is a single trapezoid. Symmetric bull spread and the positive side of symmetric 
trapezoidal hedge are depicted in Figure |21 and Figure El respectively. 




-k-1 ~k k k + 1 

Figure 2: Symmetric bull spread 



— h 

k-1 k k + 1 k + 2 
Figure 3: Symmetric trapezoidal hedge (positive side only) 

Now we state the following theorem. 

Theorem 4.1. Suppose that the set of hedges H = {hk{x) = {\x\ — k)^ | A; = 0, 1, 2, . . . } 

are available to Skeptic. Then in the unbounded forecasting game with Ti Skeptic can force 
Xn 0. 

The rest of this section is devoted to a proof of this theorem. As in the previous 
section we prove it by a series of lemmas. 

Lemma 4.1. Under the condition of Theorem \4 . 1\ Skeptic can force E2 in ©. 

Proof. For A; > 1, (|x| — k + 1)+ — — A;)+ > I[k,oo){\x\) and 

00 00 
^{{\xn\-n + 1)+ - - n)+) > /[„,oo)(|a;„|). 

n=l n=l 
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The left-hand side can be bought with the total finite price of vq. The rest of the proof is 
the same as in Lemma f3. II □ 

Lemma 4.2. Under the condition of Theorem \4 . 1\ Skeptic can force in (ffj). 



Proof. At round n Skeptic is to buy {k + 1)^ units of the symmetric trapezoidal hedge Tk 
for each k = 0,1, . . . ,n — 1. We note 

n-l 
k=0 

Dividing the above by and summing up over all rounds n = 1, 2, . . . , we have 

n=l fc=0 n=l 

Now we evaluate the total price of the left-hand side. Since Tk is available at each round, 
the price is the same if we replace x„ by Xi in T^. Then 

oo n— 1 /7|-|\2 oo^ra oo oo^ 

n=l fc=0 n=l 1=1 1=1 n=l 



<2j2^Ti_,{xi) <6\xi\. 



1=1 

As noted above |xi| is available to Skeptic with finite price uq, so that the left-hand side 
is also available to him with the total finite price 

- :^(A;+l)2 

n=l A,-0 

The rest of the proof is the same as in Lemma 13.11 □ 
In the following Xn hedged by — n)+ is denoted as 

X n^. 



"1 



Xn,n Xn ~\~ (^\Xn\ ^)+ \ X^, n ^ X^ ^ H, 

2x 

This has the price Un- Similarly we denote Xn,n = —Xn + {\xn \ — n)+ which is —Xn hedged 
by {\xn\ — Note that 

On £"2? Xn,n and Xnl{\xn\<n] differ only for finite number of n. Therefore conditional on 
E2, Skeptic can force 

n n 
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Lemma 4.3. Under the condition of Theorem \4.1\ and conditional on E2, Skeptic can 
force 



n 

Proof. Since - Vnf < '^xln + 21/^ 

N , ^2 N 2 N 2 N 2 2 

V- l^rv^^i^ < 2 V ^ + 2 V ^ < 2 V ^ + 2 z/o^ ^ 

^2 ^2 ^2 ^2 u g 

n=l n=l n=l ?i=l 

By (ITT|) . conditional on i?2, Skeptic can force ^^ia;^„/n^ < 00. Therefore conditional 
on E2, he can force □ 

Similarly Skeptic can force E^ with Xn,n replaced by Xn,n- 

Finally the following lemma proves Theorem 14.11 in conjunction with Kronecker's 
lemma. 

Lemma 4.4. Under the condition of Theorem \4 ■ 1\ Skeptic can weakly force 
-^4 = I ~ converges to a finite value} 



n 



conditional on i?2 H -Eg. 
Proof. We take e as 



1 

< e < 



2(l + z/o)' 

and consider Skeptic's strategy betting e/C„_i/n on x„^„ — at round n. Then his capital 
at the end of round n is 



n -^-^ t 

i=l 

By the choice of e and \xi^i/i\ < 1, 



SO that from log(l + 1) > t — for t > —1/2, his log capital is bounded from below as 

n n 

log/C„ > log /Co + e ^ — ^-e^^ 



i=l i=l 



In the right-hand side the third term is bounded on E^. By considering this inequality 
for the interval n < i < n', we have 



log /C„/ - log ICn-i > e — ~ 



i=n 
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As in the proof of Lemma ITBl considering both and x„,„, log/C^ converges to a finite 
Hmit almost surely, and thus by Cauchy criterion we see that 



n 



E 



converges almost surely. □ 
As proved in Appendix El ~^ as n ^ cxd. Then by Kronecker's lemma we have 

n 1 " 1 " 

- - Vi) = - y^Xi^i y^Ui ^ &s n ^ oo. 

1=1 i=l i=l 

In the above, (l/n) Yl^=i^i — ^ so that J2i=i^i,i/^ ^ilso converges to 0. Since x„ and 
Xn,n differ only for finite number of n on E2, it is concluded that Xn converges to almost 
surely. This completes the proof of Theorem 14.11 



5 Marcinkiewicz-Zygmund strong law 

In this section we consider a remarkable generalization by Marcinkiewicz and Zygmund 
(See 0) of Kolmogorov's measure-theoretic SLLN for i.i.d. random variables with 
finite expected value < 00. Marcinkiewicz-Zygmund strong law asserts that for 

i.i.d. random variables xi,X2, ■ ■ ■ with < 00 for < r < 2 and Exn = when 

1 < r < 2, the following measure-theoretic SLLN holds 



n 



l/r 



as n ^ 00 a.s. 



Considering the meaning of the hedge \xY for x in betting games, we treat the case 
1 < r < 2 and for this case establish a game-theoretic version of Marcinkiewicz-Zygmund 
SLLN. As noted in Proposition 12. H the availability of a single h{x) = \x\^ is again not 
sufficient. Hence here, for the game-theoretic Marcinkiewicz-Zygmund SLLN we assume 
that the following set of hedges are available to Skeptic. 

= U H.., where |«- = = d^l" " I ^ = > . (12) 

Let Ukr denote the price of hkr{x) = {\x\^' — k)+ and let z/^i/r denote the price of hj^i/r{x) = 
{\x\ - k^/'')+. Also assuming that Skeptic is allowed to sell and combine these hedges 
within his collateral duty, we state the following theorem. 

Theorem 5.1. Let 1 < r < 2. Suppose that the set of hedges 7i,. in fll2|) is available to 
Skeptic. Then in the unbounded forecasting game with Ttr Skeptic can force (xi + ■ ■ ■ + 
Xn)/n^^^ ^ 0. 
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Remark 5.1. In this theorem Tir consists of two sets of hedges Tiir and Ti.2r- T^2r is 

included in Ti just for convenience. Each h^i/r{x) can he superreplicated and underrepli- 
cated by an infinite combination of hedges from Tiij. and the theorem holds without H2r- 
Since this makes the proof considerably messier, we include 7i2r "in the set of hedges. We 
give more discussion on this point in Section\^ 

The proof of Theorem 15.11 proceeds almost in the same way as that of Theorem 14.11 
However we have to make different uses of hedges from Tiir and from ?i2r- At first we 
enumerate relevant events. 

E2r = I \xnY for only finite number of n}. 

n 

Lemma 5.1. Under the condition of Theorem \5. 1\ Skeptic can force E2r. 
Proof For k > I, - (k - 1))+ - - k)+ > /[fc,oo)(|a;r) and 

oo oo 

(d^'^l'^ -{n- 1))+ - - n)+) > J^/[„,oo)(|a;„r)- 

n=l n=l 

The left-hand side can be bought with the total finite price of uqj.. The rest of the proof 
is the same as in Lemma f3. II □ 

Lemma 5.2. Under the condition of Theorem \5. 1\ Skeptic can force E^^- 

Proof. Consider the following trapezoidal hedge 

TUx) = (ixr - (fc - 1))+ - (ixr - k)^ - ((|xr - + 1))+ - d^r - (a; + 2))+) 

'0, |a;|^<A;-l 

Ixl*^ - (k -1), k - I < < k 

1, k<\x\'^<k + l 

fc + 2-|xr, k + 1 Klxi' <k + 2 



0, fc + 2<|x|^ 

> ^[fe,fc+i](kr) 

with the price /Xfcr = '^fc+2,r - ^k+X^r - ^kr + Vk-X.r- 

At round n Skeptic is to buy + 1)^ units of the hedge T^j. for each = 0, 1, . . . , n — 1. 
We note 

^{k + \fT^,r{xn) > a;^/{|x„|'-<n}- 

k=0 
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Dividing the above by r?!"^ and summing up over all rounds n = 1, 2, . . . , we have 



^2 



n=l A;=0 n=l 

As in the previous section, for the consideration of the total price, we can replace T^rixr, 
by Tkr{xi). Then the left-hand side can be evaluated as 

oo n—l / 1 -I \2 oo_n oo oo^ 

E E = E E '^^,-...(.0 = E '^^.-...(.0 E ^ 

n=l k=0 n=l 1=1 1=1 n=l 

2(2/r) 



- (2/r)-l ^ /(5aFT^'^'-1''^(^^) 



o(2/r)-l °o 1 

£p7;)TTE]i5?PT(''"''"'''^'-'(^-') 



2(2/r)-l 3 . 2(2/r)- 



(2/r) - 1 ^ (2/r) - 1 



Since is available to Skeptic with finite price uor, the left-hand side is also available 
to him with the total finite price 

- ^(fc+i)2 3 -2(2/0-1 

^ (2/r) - 1 

n=l k=0 ^ ' ' 

□ 

So far we have used hedges from Tii,, for forcing various events. In the following x„ 
will be hedged by elements from 7i2r- We hedge x„ by h^i/r{xn) = — n^^^)^. Write 

•^nn,r •^n ~l~ (I'^nl ^ ^ ) + • 

This has the price t'^i/r-. On E2r, Xnn,r and Xnl{\xn\^<n} differ only for finite number of n. 
Therefore conditional on E2r, Skeptic can force 

^^3. = «iE^<°°}- (") 

n 

Lemma 5.3. Under the condition of Theorem I5.il and conditional on E2r, Skeptic can 
force 

E^r = {i\2^ < oo}. 
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Proof. 

n n n 

Both terms are finite on E2r- □ 

Now we use the e-strategy as before. 
Lemma 5.4. Under the condition of Theorem \5. 1\ Skeptic can weakly force 

^4r = I ""'^ j^y^ converges to a finite value} 



conditional on H i?3r. 
Proof. We take e as 



< e < ^ 



2(1 + 1^0) 

and consider Skeptic's strategy betting e/C„_i/n on Xn,n — v^iir at round n. Then his 
capital at the end of round n is 



/C„ = /C„_i(l + -{Xnn.r " ^^nvO) = ^0 TT(1 + -(a;M,r " '^ji/O)- 



1=1 



By the choice of e and \xii^rl'i^^~^\ < 1, 



e 1 

so that from log(l + 1) ~^t — t^ for t > —1/2, his log capital is bounded from below as 



log ^„ > log ^0 + e 5: -^Y^ 



i=l " i=l 



In the right-hand side the third term is bounded on Er,^. By considering this inequality 
for the interval n < i < n' 



( ^2 



log Kn' - log /C„,i > e ^ "'^^^^^ " - I] ^2A 
In the above log /C„ converges to a finite limit almost surely, and thus as before 

n 



7T 



/r 
1=1 

converges almost surely. □ 
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We now need to take care of n ^l""' ^Y^i=\ ^i^i^- 
Lemma 5.5. 

1 ^ 

—rr 7 ^i^/r ^0 as n — >• oo. 



1=1 



Proof. Since r > 1 



Also for |x| > n^/'" we have \xY ^ >'n} ^1"^ . Therefore 



I Ir— 1 

= n^/'^-^(|a;r-n)+ 
It follows that the prices of {\x\ — n^^^')^ and — n)+ have to satisfy 



Therefore 

^ n ^ n 



1=1 i=l 



Note that z/j,, — * as z ^ oo by the argument in Appendix ^ Then the right-hand side 
converges to as n — oo by Cesaro's lemma (12.6 of [lOj). □ 

Now by an extended form of Kronecker's lemma (12.7 of ^lOJ ) 

^ n \ ^ \ ^ 

^ 5^(xn,. - z^.i/O = ^Y1 -n^Yl ^^^Z" ^0 as n ^ oo. 

j=l i=l i=l 

SO that X]r=i also converges to 0. Since Xn and x„„,r differ only for finite number 

of n on E2r, it follows that (xi-|-- ■ ■+Xn)/n^^^ converges to almost surely. This completes 
the proof of Theorem 15.11 

6 Some discussions 

In this paper we proved various game-theoretic versions of SLLN for unbounded variables. 
In Section E] we proved a version corresponding to the sample average of i.i.d. measure- 
theoretic random variables. There we assumed availability of countable symmetric call 
option type hedges. We chose this set of hedges for convenience and concreteness. Other 
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choices are equally conceivable, as long as the set of hedges is rich enough to produce 
step-function type hedges (cf. Figure |21). 

We might as well assume that if a hedge h is available to Skeptic, all other hedges 
weaker then h are available to him with price no more than that of h. We call a set of 
hedges TC weakly closed if 

h en, < g{x) < h{x),^x eR g e H. 

We might argue that this is a reasonable assumption, because if h is available to Skeptic, 
he can ask to buy a weaker g with the same price as h and someone should be willing to 
sell g to Skeptic with the same price, because it presents an arbitrage opportunity to the 
seller. If 7i is weakly closed, then for each t G M 

Ii-oo,t]{x) 

has to be available to Skeptic. This shows that if Ti. is weakly closed, then the entire 
distribution function of the Reality's move x is priced in the game. The assumption of 
weakly closed Ti seems to be too strong from game-theoretic viewpoints. However we 
should mention that in measure-theoretic proofs the probability distribution is assumed 
and truncation is freely used. 

The discussion on generality of probability games in Chapter 8 of Shafer and Vovk 
(2001) convincingly argues that measure-theoretic martingales can be reduced to game- 
theoretic martingales. If we interpret Theorem Kill in measure-theoretic terms and just 
rewrite our proof in measure-theoretic terms, we obtain the following result. 

Proposition 6.1. Let {Yn} be a measure-theoretic martingale adapted to an increasing 
family ofcx-fields {J-'n}- Let h be a function satisfying (A1)-(A3). If the measure-theoretic 
conditional expectation 

E[h{Yr, - Yn-l) I J'n-l] 

is uniformly bounded, then P{limnYn/n = 0) = 1. 

Except for Proposition 12. II we could avoid measure theory to establish our theorems. 
We believe that this again shows effectiveness of game-theoretic proofs as we have shown 
in our previous works jl]). 

For the Marcinkiewicz-Zygmund strong law in Section^lwe have given a game-theoretic 
proof for r > 1. We also assumed availability of two kinds of hedges for convenience as 
we discussed in Remark 15.11 If we make the blanket assumption that 7i is weakly closed, 
then we believe that measure-theoretic proof of the Marcinkiewicz-Zygmund strong for 
< r < 1 can be translated to game-theoretic proof without too many modifications. 
From game-theoretic viewpoint however, the case r < 1 does not seem to be natural. 

A Proofs of Proposition 12.11 and Proposition 13.11 

Proof of Proposition }^. 11 We argue by contradiction. Suppose there exists Skeptic's 
strategy V which allows Skeptic to observe his collateral duty with the initial capital 
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JCq = 1 and lim„/C^ = oo whenever Sn/n^^^ 7^ 0, where s„ = xi + ■ ■ ■ + Xn- Consider a 
random strategy of Reahty, where each a;„, n > z/, is independently chosen as 

Pixn = 0) = 1 - Pixn = n'^n = P{xn = -n^'"-) = ^. 

n In 

Here v is the price of h{x) = \x\^'. Then by the second part of measure-theoretic Borel- 
CanteUi lemma 

1 = P(|x„| = n^/'- t.o.) = P{\xn\/n^^'' = 1 t.o.). (14) 
Note that if Sn/n^^^ — > 0, then Xn/n^^^ because 

n-l\^/r Sn-l ^ Xn 



i/r \ n J nV^' 



Therefore (fT^ implies that P{sn/n^^^ — > 0) = 0. Then by our assumption P{K,^ — *■ 
00) = 1. However under the randomized strategy of Reality /C^ is a measure-theoretic 
non- negative martingale and its measure-theoretic expectation is E{)C^) = JCq = 1. Then 
by Doob's martingale inequality (e.g. Theorem 14.6 of |lUj ) 

P(max/C^ > c) < -, Vc> 0,Vn. 

k<n C 

and P(sup„ /C^ > c) < 1/c. But this contradicts P{JC^ — > 00) = 1. □. 

Proof of Proposition \3.1\ Consider a random strategy of Reality, where each Xn for 
n, h{n) > u, is independently chosen as 

P{Xn = 0) = 1 - -f-, P{Xn = n)= P{Xn = -u) 



h{n)' ' " ' ' " ' 2h{n)' 
The rest of the proof is the same as the proof of Proposition 12.11 □ 



B Proof of the fact liniy^^oo = ^ 

Consider the identity for x G M: 

00 

\x\ = Y,{i\^\ - k)+ - {\x\ - k - (15) 

For each real x, the right-hand side is actually a finite sum and there is no question on 
the convergence. On the other hand consider the identity 

K-l 
k=0 
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Since {uk} is a monotone non-increasing sequence of non- negative reals 

c = lim vr^^ 

K—>co 

exists. If c > then, uq > YlT=o(^k — ^k+i)- But then Skeptic can sell |a;| and buy the 
right-hand side of (|15|) and he is certain to make money. This contradicts the assumption 
of coherence. 
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